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Multi-head finite automata were introduced in |36l and [38]. Since that time, a vast literature on 
computational and descriptional complexity issues on multi-head finite automata documenting the 
importance of these devices has been developed. Although multi-head finite automata are a sim- 
ple concept, their computational behavior can be already very complex and leads to undecidable 
or even non-semi-decidable problems on these devices such as, for example, emptiness, finiteness, 
universality, equivalence, etc. These strong negative results trigger the study of subclasses and al- 
ternative characterizations of multi-head finite automata for a better understanding of the nature of 
non-recursive trade-offs and, thus, the borderline between decidable and undecidable problems. In 
the present paper, we tour a fragment of this literature. 



1 Introduction 

Languages accepted by multi-tape or multi-head finite automata were introduced in (361 and (381 . Since 
that time, many restrictions and generalizations of the original models were investigated and studied (see, 
e.g., fiTTl ). Two-way deterministic and nondeterministic multi-head finite automata are probably best 
known to characterize the complexity classes of deterministic and nondeterministic logarithmic space. 
In fact, in 01 it was shown that the question of the equality of deterministic and nondeterministic loga- 
rithmic space is equivalent to the question of whether every language accepted by some nondeterministic 
two-way three-head finite automaton is accepted by some deterministic two-way multi-head finite au- 
tomaton. Later this result was improved in (441 . Deterministic and nondeterministic one- and two-way 
multi-head finite automata induce strict hierarchies of language families with respect to the number of 
heads (HI 081 

Although multi-head finite automata are very simple devices, their computational behavior is already 
highly complex. But what about the size of multi-head finite automata opposed to their computational 
power? Questions on the economics of description size were already investigated in the early days of 
theoretical computer science and build a cornerstone of descriptional complexity theory (27ll35ll42l . In 
terms of descriptional complexity, a known upper bound for the trade-off between different descriptional 
systems answers the question, how succinctly a language can be represented by a descriptor of one de- 
scriptional system compared to an equivalent description of another descriptional system. When dealing 
with more complicated devices such as, for example, pushdown automata that accept regular languages, 
a qualitative phenomenon revealed, namely that of non-recursive trade-offs. There the gain in economy 
of description can be arbitrary, that is, there are no recursive functions serving as upper bounds for the 
trade-off. This phenomenon was first discovered in (271, and in the meantime, a lot of deep and inter- 
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esting results on non-recursive trade-offs have been found for powerful enough computational devices 
almost everywhere (see, e.g., Bl 171 151 KH 1221 B51B5I). 

Concerning descriptional complexity in connection with multi-head finite automata, in |[22l it is 
shown that the simulation of 1NFA(2) by 1DFA(&), for k>2, causes non-recursive trade-offs. Similar 
results hold for two-way devices as well |[T8l . An immediate consequence from the proofs of these results 
is that almost all of the aforementioned elementary questions become undecidable — in fact they are even 
shown to be not semi-decidable. Furthermore, because of these non-recursive trade-offs pumping lemmas 
and minimization algorithms for the automata in question do not exist. These strong negative results 
trigger the study of subclasses of multi-head finite automata for a better understanding of the nature of 
non-recursive trade-offs and, thus, the borderline between decidable and undecidable problems. From 
the legion of possible research directions we focus on three alternative and intermediate computational 
models, namely (i) multi-head automata accepting bounded languages, (ii) data-independent or oblivious 
multi-head finite automata, and (iii) parallel communicating finite automata. While the former research 
on bounded languages dates back to |3J, the latter two topics were recently investigated in (91 [lOj and ID. 
In fact, for some of these models, some of the aforementioned elementary questions turn out to become 
decidable, while for others undecidability remains. At this point it is worth mentioning, that recently 
it was shown that even stateless one-way multi-head finite automata have a non-decidable emptiness 
problem |[T4l . In fact, these devices are the most simple one, since they have one internal state only. 

In the present paper we tour a fragment of the literature on computational and descriptional complex- 
ity issues of multi-head finite automata. It obviously lacks completeness, as one falls short of exhausting 
the large selection of multi-head finite automata related problems considered in the literature. We give 
our view of what constitute the most recent interesting links to the considered problem areas. 

2 Multi-Head Finite Automata 

We denote the set of non-negative integers by N. We write Z* for the set of all words over the finite 
alphabet E. The empty word is denoted by A, and £ + = £* \ {A}. The reversal of a word w is denoted 
by w R and for the length of w we write |w|. We use C for inclusions and C for strict inclusions. We 
write 2 s for the powerset of a set S. 

Let k > 1 be a natural number. A two-way &-head finite automaton is a finite automaton having a 
single read-only input tape whose inscription is the input word in between two endmarkers. The k heads 
of the automaton can move freely on the tape but not beyond the endmarkers. A formal definition is: 

Definition 1. A nondeterministic two-way fc-head finite automaton (2NFA(&)) is a system 
(S,A,k,8,\>,<],so,F), where S is the finite set of internal states, A is the set of input symbols, k > 1 
is the number of heads, > ^ A and < ^ A are the left and right endmarkers, sq G S is the initial state, 
F C S is the set of accepting states, an 8 is the partial transition function mapping S x (AU {>,<i}) k 
into the subsets of S x {—1,0, 1}*, where 1 means to move the head one square to the right, —1 means 
to move it one square to the left, and means to keep the head on the current square. Whenever 
(V, , . . . ,dk)) G 8(s,(ai,...,a] c )) is defined, then d\ G {0,1} if a, = >, and di G {—1,0} if ai = <\, 
1 < i < k. 

A 2NFA(&) starts with all of its heads on the first square of the tape. It halts when the transition func- 
tion is not defined for the current situation. A configuration of a 2NFA(&) M = (S,A,k,8,>,<,so,F) 
at some time t with t > is a triple c t = (w,s,p), where w is the input, s G 5 is the current state, 
and p = (pi, . . . ,pk) G {0, . . . , \w\ + 1}* gives the current head positions. If a position pi is 0, then 
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head i is scanning the symbol >, if it is n + 1, then the head is scanning the symbol <l. The ini- 
tial configuration for input w is set to (w, so, (1, . . . , 1)). During its course of computation, M runs 
through a sequence of configurations. One step from a configuration to its successor configuration is 
denoted by K Let w = a\ci2 ...a n be the input, ao = >, and a n+ \ = <\, then we set (w,s, (pi, . . . ,pk)) l~ 
(w,s', (pi + d\, . . . ,pk + dk)) if and only if (s', (d\ , . . . ,dt)) € 5(s, (a Pl ,...,a Pk )). As usual we define the 
reflexive, transitive closure of h by h*. Note, that due to the restriction of the transition function, the 
heads cannot move beyond the endmarkers. 

The language accepted by a 2NFA(&) is precisely the set of words w such that there is some compu- 
tation beginning with \>w< on the input tape and ending with the 2NFA(&) halting in an accepting state, 
i.e.,L(M) = {w£A*\ (w,s ,(l,...,l)) h* (w,s,(pi,...,p k )),s e F, and M halts in (w,s,(pi,...,p k ))}. 
If in any case 8 is either undefined or a singleton, then the &-head finite automaton is said to be determin- 
istic. Deterministic two-way &-head finite automata are denoted by 2DFA(&). If the heads never move to 
the left, then the &-head finite automaton is said to be one-way. Nondeterministic and deterministic one- 
way &-head finite automata are denoted by 1NFA(&) and 1DFA(&). The family of all languages accepted 
by a device of some type X is denoted by Jzf (X). 

The power of multi-head finite automata is well studied in the literature. For one-head machines we 
obtain a characterization of the family of regular languages REG. A natural question is to what extent 
the computational power depends on the number of heads. For (one-way) automata the proper inclusion 
Jzf (1NFA(1)) C Jzf (1DFA(2)) is evident. An early result is the inclusion which separates the next level, 
that is, Jzf (1DFA(2)) C Jzf (1DFA(3)) EH. The breakthrough occurred in (H, where it was shown 
that the language L n = {wi$W2$ . . . $W2„ | w\ G {a,b}* and w; = W2n+i-i for 1 < j < n} can be used to 
separate the computational power of automata with k + 1 heads from those with k heads in the one-way 
setting: 

Theorem 2. Let k>\. Then Jf(lDFA(k)) C 5?(lDFA(k+ 1)) and Sf(lNFA(k)) C ^f(lNFA(k+ 1)). 

By exploiting the same language, the computational power of nondeterministic classes could be 
separated from the power of deterministic classes. To this end, for any n the complement of L n was 
shown to be accepted by some one-way two-head nondeterministic finite automaton. Since the deter- 
ministic language families Jzf (1DFA(&)) are closed under complementation, it follows that the inclu- 
sions Jzf(lDFA(&)) C Jzf(lNFA(&)) are proper, for all k > 2. In order to compare one- and two-way 
multi-head finite automata classes, let L = { w | w S {a,b}* and w = w R } be the mirror language. It is 
well known that the mirror language is not accepted by any 1NFA(&), but its complement belongs to 
Jzf (1NFA(2)). The next corollary summarizes the inclusions. 

Corollary 3. Let k > 2. Then &{lDFA(k)) C ££{2DFA(k)\ J£{lDFA(k)) C £?(lNFA(k)), and 
J?(lNFA(k)) C J?(2NFA(k)). 

From the complexity point of view, the two-way case is the more interesting one, since there is 
the following strong relation to the computational complexity classes L = DSPACE(log(?i)) and NL = 
NSPACE(log(ra)) & 

Theorem 4. L = U*>i &{2DFA{k)) and NL = \J k > x 5?(2NFA(k)). 

Concerning a head hierarchy of two-way multi-head finite automata, in ll28l it was shown that k + 1 
heads are better than k. Moreover, the witness languages are unary. 

Theorem 5. Let k > 1. Then there are unary languages that show the inclusions J£(2DFA(k)) C 
&{2DFA(k+l)) and&(2NFA{k)) C 5?(2NFA(k+ 1)). 

Whether nondeterminism is better than determinism in the two-way setting, is an open problem. 
In fact, in P4l it was shown that the equality for at least one k > 2 implies L = NL. More generally, 
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L = NL if and only if Jz? (1NFA(2)) C Ujfc>i -£?(2DFA(A:)) was shown in El • Due to a wide range of 
relations between several types of finite automata with different resources, the results and open prob- 
lems for k-head finite automata apply in a similar way for other types. Here, we mention deterministic 
two-way finite automata with k pebbles (2DPA(&)), with k linearly bounded counters (2DBCA(fc)), and 
with k linearly bounded counters with full-test (2DBCFA(&)). In order to adapt the results, we present 
the hierarchy jgf (2DFA(Jfc)) C J^(2DPA(&)) C ^(2DBCA(fc)) C «£f (2DBCFA(&)) C ^(2DFA(&+ 1)) 
which has been shown in several famous papers, e.g., Il2"9ll33ll37ll45l . 

3 Descriptional Complexity 

It is natural to investigate the succinctness of the representations of formal languages by different mod- 
els. For example, it is well known that two-way and one-way finite automata are equivalent. Recently, 
the problem of the costs in terms of states for these simulations was solved in |fl9l by establishing a tight 
bound of (^j) for the simulation of two-way deterministic as well as nondeterministic finite automata 
by one-way nondeterministic finite automata. In the same paper tight bounds of n(n" — (n — 1)") and 
L"=o L"=o i'l) {") (2 ! — 1) ; are shown for two-way deterministic and two-way nondeterministic finite au- 
tomata simulations by one-way deterministic finite automata. Nevertheless, some challenging problems 
of finite automata are still open. An important example is the question of how many states are sufficient 
and necessary to simulate 2NFA(1) with 2DFA(1); we refer to HU |23] HU ED for further reading. All 
trade-offs mentioned so far are bounded by recursive functions. But, for example, there is no recursive 
function which bounds the savings in descriptional complexity between deterministic and unambiguous 
pushdown automata ll46l . A survey of the phenomenon of non-recursive trade-offs is |22]. Here we ask 
for the descriptional complexity of k-he&d finite automata. How succinctly can a language be presented 
by a k-head finite automaton compared with the presentation by a nondeterministic pushdown automaton, 
or by a (k+ l)-head finite automaton? 

Definition 6. A descriptional system E is a recursive set of finite descriptors, where each descriptor D 6 
E describes a formal language L(D), and there exists an effective procedure to convert D into a Turing 
machine that decides (semi-decides) the language L(D), ifL(D) is recursive (recursively enumerable). 
The family of languages represented (or described) by some descriptional system E is L(E) = {L(D) | 
D £ E }. For every language L, we define E(L) = {D € E \ L(D) = L}. 

A complexity (size) measure for E is a total, recursive function c : E — > N, such that for any al- 
phabet A, the set of descriptors in E describing languages over A is recursively enumerable in order of 
increasing size, and does not contain infinitely many descriptors of the same size. 

Let E\ and E2 be two descriptional systems, and c be a complexity measure for E\ and Ei- A function 
f : N — ► N, with f(n) > n, is said to be an upper bound for the increase in complexity when changing 
from a minimal description in E\ to an equivalent minimal description in E% if for all L E L(E\) r\L(E2) 
we have min{ c(D) \ D E £2 (L) } < /(min{ c(D) \ D G E\ (L) }) . If there is no recursive upper bound, the 
trade-off is said to be non-recursive. 

In connection with multi-head finite automata the question of determining the trade-offs between the 
levels of the head hierarchies arises immediately. Recently, the problem whether these trade-offs are 
non-recursive has been solved for two-way devices in the affirmative |[T8l (cf. also ED): 

Theorem 7. Letk > 1. Then the trade-off between deterministic (nondeterministic) two-way (k+\)-head 
finite automata and deterministic (nondeterministic) two-way k-head finite automata is non-recursive. 
Moreover, the results hold also for automata accepting unary languages. 
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But how to prove non-recursive trade-offs? Roughly speaking, most of the proofs appearing in 
the literature are basically relying on one of two different schemes. One of these techniques is due to 
Hartmanis (TJEl. Next, we present a slightly generalized and unified form of this technique l[2l"ll22ll . 

Theorem 8. Let E\ and E% be two descriptional systems for recursive languages. If there exists a 
descriptional system £3 such that, given an arbitrary M £ £3, (i) there exists an effective procedure to 
construct a descriptor in E\ for some language Lm, (H) Lm has a descriptor in E2 if and only if L(M) 
does not have a property P, and ( Hi) property P is not semi-decidable for languages with descriptors 
in £3, then the trade-off between E\ and £2 is non-recursive. 

In order to apply Theorem [8] one needs a descriptional system £3 with appropriate problems that are 
not even semi-decidable. An immediate descriptional system is the set of Turing machines for which 
only trivial problems are decidable and a lot of problems are not semi-decidable. Basically, we consider 
valid computations of Turing machines @. Roughly speaking, these are histories of accepting Turing 
machine computations. It suffices to consider deterministic Turing machines with one single tape and one 
single read-write head. Without loss of generality and for technical reasons, we assume that the Turing 
machines can halt only after an odd number of moves, accept by halting, make at least three moves, 
and cannot print a blank. A valid computation is a string built from a sequence of configurations passed 
through during an accepting computation. Let S be the state set of some Turing machine M, where sq is 
the initial state, T n S = is the tape alphabet containing the blank symbol, A C T is the input alphabet, 
and F C S is the set of accepting states. Then a configuration of M can be written as a word of the form 
T*ST* such that t\ ... ...t„ is used to express that M is in state s, scanning tape symbol , and t\ 

to t„ is the support of the tape inscription. 

For the purpose of the following, valid computations VALC(M) are now defined to be the set of 
words $wi $W2$ . . . $W2„$, where $ ^ T U S, vv; € T*ST* are configurations of M, w\ is an initial config- 
uration of the form sqA* , W2 n is an accepting configuration of the form T*FT* , and w i+ i is the successor 
configuration of vv/, for 1 < i < 2n. The set of invalid computations INVALC(M) is the complement of 
VALC(M) with respect to the alphabet {$} U T U S. 

Now we complement the results on the trade-offs between the levels of the head hierarchy for two- 
way automata. We show non-recursive trade-offs between the levels of the head hierarchies of determin- 
istic as well as nondeterministic one-way devices. Moreover, non-recursive trade-offs are shown between 
nondeterministic two-head and deterministic &-head automata. 

Example 9. Let M be a Turing machine. Then an 1DFA(2) M' can be constructed that accepts 
VALC(M). One task of M' is to verify the correct form of the input, that is, whether it is of the form 
$sqA*$T*ST*$.. . $T*ST*$T*FT*$. This task means to verify whether the input belongs to a regular 
set and can be done in parallel to the second task. 

The second task is to verify for each two adjacent subwords whether the second one represents the 
successor configuration of the first one. We show the construction for Wj$Wi + \. Starting with the first 
head on the first symbol ofwj and the second head on the first symbol ofwj + i, automaton M' compares the 
subwords symbolwise by moving the heads to the right. Turing machine M has three possibilities to move 
its head. So, Wi = t\... hsti + \ ...t„ goes to t\... tis't' i+l . . . t n , to ti ... s'tit\ +l . . . t n , or to t\... tit' j+l s' . . . t n . 
Each of the three possibilities can be detected by M'. Furthermore, M' can verify whether the differences 
between w, and Wf+i are due to a possible application of the transition function ofM. Finally, the first 
head is moved on the first symbol ofwi + \, and the second head is moved on the first symbol of 'w ' i+ 2 to 
start the verification ofwj+i and W;+2. 

Theorem 10. Let lc>2. The trade-off between lDFA(k) and nondeterministic pushdown automata is 
non-recursive. 
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Proof. In order to apply Theorem[8j let £3 be the set of Turing machines. For every M G £3, define L M to 
be VALC(M). So, L M is accepted by some 1DFA(&). In lH it was shown that VALC(M) is context free 
if and only if L(M) is finite. Since infiniteness is not semi-decidable for Turing machines, all conditions 
of Theorem [8] are satisfied and the assertion follows. □ 

Corollary 11. Let k>2. The trade-off between lDFA(k) and 1NFA(\) is non-recursive. 



In the following we exploit the basic hierarchy theorem shown in ||48l , and recall that the language 
L n = {wi$W2$ • • • $W2„ I vv; 6 {a,b}* and w,- = W2„+i-,- for 1 < i < n} is accepted by some deterministic 
or nondeterministic one-way fc-head finite automaton if and only if n < (^) . Now we extend the language 
in order to meet our purposes. Basically, the idea is to keep the structure of the language but to build the 
subwords w\ over an alphabet of pairs, that is, w,- = "j ^ "' " m , where the uj and vj are symbols such that 
the upper parts of the subwords are words over {a,b} as in L n . The lower parts are valid computations 
of some given Turing machine M. Let Wm — { \ u G \a,b\* ,v G VALC(A/), \u\ — |v| }. Then is 
defined to be {wi$W2$ ■ • • $W2„ | w, G Wm and w,- = W2n+i-i for 1 < i < n }. 

Lemma 12. Let k > 2 and M be some Turing machine. Then a lDFA(k + 1) can be constructed that 
accepts L^ +l M . 

Proof. Let n = (*) + 1- We sketch the construction. At first, two of the heads, say the first and 
{k+ l)st one, are used to verify that the lower parts of the subwords W\,W2, ■ ■ ■ ,w n do belong to VALC(M) 
(cf. Example [9]). At the end of this task, both heads are positioned at the beginning of w n+ \. Next, the 
first head is moved to the beginning of W2„ + \-(k-\) while the remaining k — 1 heads are moved to the 
beginnings of wi,W2, • • . ,Wk-i, respectively. Now the k — 1 words w ln +i-{k-\) to w 2n are successively 
compared with the words wt-i to w\. Next, the k — 1 heads are moved to the beginning of wu, and the 
same procedure is applied inductively to verify wu$Wk+\$ ■ ■ ■ $W2n+\-k- 

After k — 1 repetitions Yd=k-\i = = (2) P a i fS nave been compared, that is, the pairs w,- and 
W2n+i-;, for 1 < i < n — 1. So, one of the heads that compared w„_i and w n+ 2 is positioned at the 
beginning of w n . Since head k+ 1 is still positioned at the beginning of w n +i, the remaining pair w n and 
w n+ \ can be compared. □ 



It is a straightforward adaption of the hierarchy result of 11481 to prove that the language m ^ s 

not accepted by any 1NFA(&) if L(M) is infinite. 

Now we can apply Theorem [8] in order to show the non-recursive trade-offs between any two levels 
of the deterministic or nondeterministic head hierarchy. 

Theorem 13. Let k>\. The trade-offs between lDFA(k+l) and lDFA(k), between lNFA(k+l) and 
lNFA(k), and between lDFA{k + 1) and lNFA(k) are non-recursive. 

Proof. For k = I, the theorem has been shown by Corollary QT] So, let k>2. We apply Theorem [8] 
by setting £3 to be the set of Turing machines and Lm = m- ^ s P ro P ert y P we choose infinite- 

ness. Lemma [12] shows that the language Lm is accepted by some 1DFA(& + 1) and, therefore, by some 
1NFA(&+ 1). On the other hand, language Lm is not accepted by any 1NFA(&) and, therefore, not ac- 
cepted by any YDFA(k) if L(M) is infinite. Conversely, if L(M) is finite, the set VALC(M) is finite. This 
implies that m = is finite and, thus, is accepted by some 1DFA(/:) and, therefore, by some 

lNFA(jk). □ 
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The next question asks for the trade-offs between nondeterministic and deterministic automata. 
Clearly, the trade-off between 1NFA(1) and 1DFA(1) is recursive. But following an idea in R8l which 
separates nondeterminism from determinism, we can show non-recursive trade-offs on every level k > 2 
of the hierarchy as follows. 

Theorem 14. Let k>2. Then the trade-off between 1NFA{2) and lDFA{k) and, thus, between lNFA(k) 
and lDFA(k) is non-recursive. 

Another consequence of the fact that the set of valid computations is accepted by &-head finite au- 
tomata is that many of their properties are not even semi-decidable. We can transfer the results from 
Turing machines. 

Theorem 15. Letk>2. Then the problems of emptiness, finiteness, infiniteness, universality, inclusion, 
equivalence, regularity, and context-freedom are not semi-decidable for J?(lDFA(k)), J£(lNFA(k)), 
5£(2DFA{k)), and J?(2NFA(k)). 

Theorem 16. Let k>2. Then any language family whose word problem is semi-decidable and that 
effectively contains the language families Sf(lDFA(k)), Jf(lNFA(k)), Sf(2DFA(k)), or Jt?(2NFA(k)) 
does not possess a pumping lemma. 

Finally, note that no minimization algorithm for the aforementioned devices exists, since otherwise 
emptiness becomes decidable, which contradicts Theorem [131 

Theorem 17. There is no minimization algorithm converting some lDFA(k), lNFA(k), 2DFA(k), or 
2NFA(k), for k > 2, to an equivalent automaton of the same type with a minimal number of states. 

4 Alternative and Intermediate Computational Models 

The existence of non-recursive trade-offs and the undecidability of many decidability problems for multi- 
head finite automata is at least disconcerting from an applied perspective. So, the question arises under 
which assumptions undecidable questions become decidable. Here we focus on three different alternative 
and intermediate computational models, namely (i) multi-head automata accepting bounded languages, 
(ii) data-independent or oblivious multi-head finite automata, and (iii) parallel communicating finite 
automata. 

4.1 Multi-Head Finite Automata Accepting Bounded Languages 

If we impose the structural restriction of "boundedness," then for context-free grammars and pushdown 
automata it is known that the trade-offs become recursive and decidability questions become decid- 
able ll24l . In this section, we summarize corresponding results for multi-head finite automata accepting 
bounded languages. 

Definition 18. Let A = {a\,a2,- ■ ■ ,a n }. A language L C A* is said to be letter-bounded or bounded ;/ 

L C a\a\ . . . a*. A subset P C N" is said to be a linear set if there exist a®, Gt\ , . . . , a m in W such that 
P = {j3|/3=o;o + Y!iL\ a iOCi, where a,- > 0, for 1 < i < m } and P is said to be semilinear if it is the finite 
union of linear sets. 

In order to relate bounded languages and semilinear sets we introduce the following notation. For an 
alphabet A = {a\,a%, ■ ■ ■ } a n } the Parikh mapping *F : £* — > N" is defined by x ¥(w) = 
(\w\ ai ,\w\ a2 , . . . ,\w\ an ), where \w\ Uj denotes the number of occurrences of a,- in the word w. We say 
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that a language is semilinear if its Parikh image is a semilinear set. In |[3T1 a fundamental result con- 
cerning the distribution of symbols in the words of a context-free language has been shown. It says that 
for any context-free language L, the Parikh image *P(L) = {*P(w) | w G L} is semilinear. Semilinear 
sets have many appealing properties. For example, they are closed under union, intersection, and com- 
plementation Q. Furthermore, bounded semilinear languages have nice decidability properties, since 
the questions of emptiness, universality, fmiteness, infiniteness, inclusion, and equivalence are decid- 
able (cf. 01). The main connection between bounded languages and multi-head finite automata is the 
following result Ifl3ll43l . 

Lemma 19. Let k>\ and L be a bounded language accepted by a 2NFA(k) which performs a constant 
number of head reversals. Then *P(L) is a semilinear set. 

The above characterization implies immediately that there are no one-way multi-head finite automata 
which accept the non-semilinear language L\ = {a 1 " \ n > 1 }. The situation changes for unbounded 
languages. For example, the non-semilinear language L2 = {aba 2 ba 3 b . . .a n b \ n > 1} is accepted by 
some 1DFA(2) by checking that the size of adjacent a-blocks is always increasing by one. Due to 
the relation to semilinear sets and their positive decidability results we obtain the borderline between 
decidability and undecidability as follows. 

Theorem 20. Letk>2. The problems of emptiness, universality, fmiteness, infiniteness, inclusion, and 
equivalence are undecidable for the language families J£(lDFA(k)), J?(lNFA(k)), Jzf(2DFA(k)), and 
J>?(2NFA(k)), if the automata are allowed to perform at most a constant number of head reversals. The 
problems become decidable for bounded languages. 

We next summarize results concerning decidability questions on models which are generalized or 
restricted versions of multi-head finite automata. Let us start with nondeterministic two-way multi-head 
pushdown automata lfT3l which are nondeterministic two-way multi-head finite automata augmented by a 
pushdown store. In fact, the characterization in Lemma[l9]has been shown in lTT3l for the stronger model 
of nondeterministic two-way multi-head pushdown automata. So, for k > 1 let a bounded language L 
be accepted by some nondeterministic two-way &-head pushdown automaton which performs a constant 
number of head reversals. Then *P(L) is a semilinear set. 

Thus, the positive decidability results obviously hold also for such automata. As is the case for 
multi-head finite automata, we loose positive decidability and semilinearity if we drop the condition of 
boundedness. We may consider again the language L2 which is clearly accepted by a one-way two-head 
pushdown automaton as well. 

In the general model of multi-head finite automata the moves of the heads are only depending on 
the input, and a head cannot feel the presence of another head at the same position at the same time. 
If this property is added to each head, we come to the model of one-way multi-head finite automata 
having sensing heads (see [13]). This model is stronger since, for example, non-semilinear language 
{a" I n > 1 } can be accepted by a deterministic one-way finite automaton having three sensing heads, 
whereas with non-sensing heads only semilinear languages are accepted in the unary case (see Lemma[T9l). 
On the other hand, it is shown in lfT3l that every bounded language which is accepted by some nondeter- 
ministic one-way finite automaton having two sensing heads can be also accepted by some nondetermin- 
istic one-way pushdown automaton with two heads, and thus is semilinear. 

Theorem 21. The problems of emptiness, universality, fmiteness, infiniteness, inclusion, and equivalence 
are undecidable for deterministic one-way finite automata with at least three sensing heads. The afore- 
mentioned problems become decidable for nondeterministic one-way finite automata with two sensing 
heads that accept a bounded language. 
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The computational capacity of two-way finite automata with sensing heads and bounds on the num- 
ber of input reversals is investigated in iTTTTl - We next consider a restricted version of one-way multi-head 
finite automata which allows only one designated head to read and distinguish input symbols whereas the 
remaining heads cannot distinguish input symbols, that is, the remaining heads get only the information 
whether they are reading an input symbol or the right endmarker. These automata are called partially 
blind multi-head finite automata |fT6ll . In this model the decidability results are much better, since it can 
be shown that every language, not necessarily bounded, which is accepted by a partially blind nonde- 
terministic one-way multi-head finite automaton has a semilinear Parikh map. In detail, we have the 
following theorem. 

Theorem 22 ( 11611 ). (I) The problems of emptiness, finiteness, and infiniteness are decidable for par- 
tially blind nondeterministic one-way multi-head finite automata. Universality is undecidable and, thus, 
the problems of inclusion and equivalence are undecidable as well. (2) The language family accepted 
by partially blind deterministic one-way multi-head finite automata is closed under complementation. 
Thus, the problems of universality, inclusion, and equivalence are decidable. (3) The problems of empti- 
ness, universality, finiteness, infiniteness, inclusion, and equivalence are decidable for partially blind 
nondeterministic one-way multi-head finite automata that accept a bounded language. 

4.2 Data-Independent Multi-Head Finite Automata 

The notion of oblivious Turing programs was introduced in |[32l . Recently, obliviousness was investi- 
gated in relation with computational models from classical automata theory as, for example, multi-head 
finite automata in ifTOl . 

Definition 23. A k-head finite automaton M is data-independent or oblivious if the position of every 
input-head i after step t in the computation on input w is a function /m(IH>'> ? ) tnat on fy depends on i, 
t, and \w\. 

We denote deterministic (nondeterministic) one-way and two-way data-independent k-head finite 
automata by lDiDFA(fc) and 2DiDFA(&) (lDiNFA(jfc) and 2DiNFA(fc)). In El it was shown that data- 
independence is no restriction for multi-head one-counter automata, multi-head non-erasing stack au- 
tomata, and multi-head stack automata. The same is obviously true for one-head finite automata. 

Interestingly, one can show that for data-independent k-head finite automata determinism is as pow- 
erful as nondeterminism. To this end, observe that a data-independent automaton with k heads has, on 
inputs of length n, only one possible input-head trajectory during a computation. So, the only nondeter- 
minism left in the k-head nondeterministic finite automata is the way in which the next state is chosen. 
Therefore, a power-set construction shows that even data-independent determinism may simulate data- 
independent nondeterminism. Thus, we have the following theorem. 

Theorem 24. Let k > 1. Then Jf(lDiDFA(k)) = Jt?(lDiNFA(k)) and moreover £>(2DiDFA(k)) = 
&(2DiNFA(k)). 

But why are data-independent multi-head finite automata that interesting? Similarly as ordinary 
multi-head finite automata characterize logarithmic space bounded Turing machine computations |6), 
data-independent multi-head finite automata capture the parallel complexity class NC 1 , which is the 
set of problems accepted by log-space uniform circuit families of logarithmic depth, polynomial size, 
with AND- and OR-gates of bounded fan-in. We have NC 1 C L. For the characterization the following 
observation is useful: Every deterministic multi-head finite automaton that works on unary inputs is 
already data-independent by definition. Therefore, L u C \J k>1 J§f (2DiDFA(£)), where L u denotes the set 
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of all unary languages from L. However, because of the trajectory argument, we do not know whether the 
inclusion NL U C U/t>i 2DiNFA(&) holds. A positive answer would imply NL U C L u by Theoreml24l This, 
in turn, would lead to a positive answer of the linear bounded automaton (LB A ) problem by translational 
methods |[20l . In ifTOl the following theorem was shown. 

Theorem 25. NC 1 = \J k > v &(2DiDFA{k)). 

Since there exists a log-space complete language in Jzf (1DFA(2)), we immediately obtain NC 1 = L 
if and only if Jzf (1DFA(2)) C U/t>i J^(2DiDFA(&)). Similarly, NC 1 = NL if and only if JS?(1NFA(2)) C 
U>i^(2DiDFA(^)). 

What is known about the head hierarchies induced by data-independent multi-head finite automata? 
For two-way data-independent multi-head finite automata one can profit from known results 11281 . Since 
for every k > 1 there are unary languages that may serve as witnesses for the inclusions Jzf (2DFA(fc)) C 
JS?(2DFA(Jfc + 1)) and Jzf (2NFA(&)) C JS?(2NFA(Jfc+l)), we obtain the following corollary. 

Corollary 26. Let k > 1. Then J£ (2DiDFA(k)) C &{2DiDFA(k+\)). 

The remaining inclusions Jzf (2DiDFA(&)) C Jzf (2DFA(&)), for k>2, for two-way multi-head finite 
automata are related to the question of whether NC 1 = L. This parallels the issue of whether the inclu- 
sion Jzf (2DFA(&)) C Jzf (2NFA(£)) is proper for k>2. For the relationship between data-independent 
and data-dependent multi-head finite automata, we find that Jzf (2DiDFA(£)) = Jzf (2DFA(&)), for some 
k > 2, implies NC 1 = L. Moreover, it was shown in O that the head hierarchy for one-way data- 
independent multi-head finite automata is strict. Obviously, REG = Jzf (lDiDFA(l)) and, hence, REG C 
Jzf (2DiDFA(2)). By adapting the head hierarchy result of ll48l to data-independent automata the next 
theorem is shown. 

Theorem 27. Let k>\. Then 3f(lDiDFA(k)) C % '(7 DiDFA(^^- + 3)). 

Thus, we have an infinite proper hierarchy with respect to the number of heads, but the bound ob- 
tained in Theorem [27] is not very good, especially for small values of k. In fact, a separation for the first 
four levels was obtained in (9l, using the language L? n = {a l F ^$a l ' F ^$ . . . | i > 1 }, where 

F(j) is the jth Fibonacci number. It holds L/?„ € Jzf (lDiDFA(fc)), if and only if n < k '^ k 2 ^ + 1. 

Theorem 28. ^(lDiDFA{\)) c 3C(2DiDFA(2)) c Jzf (2D/DM(3)) C Sf(2DiDFA(4)). 

Whether the one-way hierarchy for data-independent multi-head finite automata is strict in the sense 
that k + 1 heads are better than k, is an open problem. Concerning the remaining open inclusions the 
following is known. 

Theorem 29. Let k>2. Then J£ (WiDFA(k)) C J£ (2DiDFA(k)). 

Moreover, by the copy language as witness we find that one-way data-independent languages are a 
proper subset of two-way data-independent multi-head finite automata languages. 

Corollary 30. \J k > x &{lDiDFA{k)) C U*>i & (2DiDFA (it)) = NC 1 . 

We close this subsection by mentioning some open problems for further research: (1) Determine the 
bounds of the conversions of one-head data-independent finite automata into one-head data-dependent 
deterministic, nondeterministic, and alternating finite automata and vice versa. (2) Consider decidability 
and complexity questions such as equivalence, non-emptiness, etc. for fc-head data-independent finite 
automata. Finally, the most interesting point for research might be (3) the one-way fc-head hierarchy for 
data-independent finite automata. Is it a strict hierarchy, in the sense that k+l heads are better than k? 
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4.3 Parallel Communicating Finite Automata 

In this section we will focus on parallel communicating finite automata systems which were introduced 
in |[25l . Basically, a parallel communicating finite automata system of degree k is a device of k finite 
automata working in parallel with each other on a common one-way read-only input tape and being 
synchronized according to a universal clock. The k automata communicate on request by states, that is, 
when some automaton enters a distinguished query state qj, it is set to the current state of automaton A,-. 
Concerning the next state of the sender A,-, we distinguish two modes. In non-returning mode the sender 
remains in its current state whereas in returning mode the sender is set to its initial state. Moreover, we 
distinguish whether all automata are allowed to request communications, or whether there is just one 
master allowed to request communications. The latter types are called centralized. 

Definition 31. A nondeterministic parallel communicating finite automata system of degree k (PCFA(k)) 
is a construct srf = (£,Ai,A2, . . . ,Afr,Q, <), where £ is the set of input symbols, each 
Aj = (Si,L,Si,soj,Fi), for 1 < i < k, is a nondeterministic finite automaton with state set Si, initial 
state sqj G Si, set of accepting states Fj C Si, and transition function 8j : Si x (£ U {A,<|}) — > 2 s ', 
Q = {<7i;<?2, • • • ,1k} Q U\<i<k^i iJ tne set °f query states, and < ^Eis the end-of-input symbol. 

The automata A\ ,A2, . • . ,A^ are called components of the system stf '. A configuration 
{s\,x\,S2,X2, ■ ■ ■ ,Sk,xt) of srf represents the current states Sj as well as the still unread parts x, of the 
tape inscription of all components 1 < i < k. System st starts with all of its components scanning 
the first square of the tape in their initial states. For input word w G £*, the initial configuration is 
(so t \,w<,so ! 2,w<, . . . jSq^jW^. Each step can consist of two phases. In a first phase, all components 
are in non-query states and perform an ordinary (non-communicating) step independently. The sec- 
ond phase is the communication phase during which components in query states receive the requested 
states as long as the sender is not in a query state itself. This process is repeated until all requests 
are resolved, if possible. If the requests are cyclic, no successor configuration exists. As mentioned 
above, we distinguish non-returning communication, that is, the sender remains in its current state, 
and returning communication, that is, the sender is reset to its initial state. For the first phase, we de- 
fine the successor configuration relation h by (s\ ,a\yi,s 2 ,a 2 y2, ■ ■ ■ ,Sk,akyk) ^ (pi,Zi,P2,Z2, ■ ■ ■ ,Pk,Zk), 
if QO{si,s 2 , ... ,Sk} =0, ai G £U {A, <}, pi G 8i(sj,aj), and n = < for a\ = < and Zi = yi otherwise, 
for 1 < i <k. For non-returning communication in the second phase, we set (s\,x\ ,S2,X2, ■■■ ,Sk,Xk) \~ 
(pi ,x\,p2,X2, ■ ■ ■ ,Pk,Xk), if, for all 1 < i < k such that Si = qj and sj ^ Q, we have pi = Sj, and p r = s r 
for all the other r, for 1 < r < k. Alternatively, for returning communication in the second phase, we set 
(s\,xi,S2,X2,-..,Sk,Xk) \~ (pi,xi,p2,X2,...,Pk,Xk), if. for all 1 < i < k such that Si = qj and Sj Q, we 
have pi = sj, pj = sqj, and p r = s r for all the other r, 1 < r < k. 

A computation halts when the successor configuration is not defined for the current situation. In 
particular, this may happen when cyclic communication requests appear, or when the transition function 
of one component is not defined. The language L{srf) accepted by a PCFA(fc) srf is precisely the set of 
words w such that there is some computation beginning with w< on the input tape and halting with at least 
one component having an undefined transition function and being in an accepting state. Let h* denote 
the reflexive and transitive closure of h and set L{srf) = {w G L* | (jo,i,w<, jo,2)W<I) . . . , so,k,w<) h* 
(pi,a\yi,p2,a2y2,- ■ ■ ,Pk,^kyk), such that G F; and 8i(pi,ai) is undefined, for some 1 < i < k}. 

If all components A,- are deterministic finite automata, then the whole system is called deterministic, 
and we add the prefix D to denote it. The absence or presence of an R in the type of the system denotes 
whether it works in non-returning or returning mode, respectively. Finally, if there is just one component, 
say A\, that is allowed to query for states, that is, 5/ PI Q = 0, for 2 < i < k, then the system is said to be 
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centralized. We denote centralized systems by a C. Whenever the degree is missing we mean systems of 
arbitrary degree. In order to clarify our notation we give an example. 

Example 32. We consider the language {w$w \ w € {a,b} + } and show that it can be accepted by a 
DCPCFA with two components. Thus, all types of systems of parallel communicating finite automata 
accept more than regular languages. The rough idea of the construction is that in every time step the 
master component queries the non-master component, and the non-master component reads an input 
symbol. When the non-master component has read the separating symbol $, which is notified to the 
master with the help of primed states, then the master component starts to compare its input symbol with 
the information from the non-master component. If all symbols up to $ match, the input is accepted and 
in all other cases rejected. The precise construction is given through the following transition functions. 



Si (^o,i, A) 


= 12 


Si {s a ,h) 


= 12 


Si {sb,k) 


= 12 


Si 


= 12 


Si (s' a ,a) 


= 12 


W b ,b) 


= 12 


5i(s<,$) 


= accept 










§2 0*0,2 1 a) 


= s a 


S2(so,2,b) 


= s b 






Si{s ai a) 


= Sa 


&2(s a ,b) 


= s b 


$2{Sa,$) 


= s s 


Si{s bi a) 


= Sa 


Siisbib) 


= s b 




= s $ 


% 

Si(s' a ,a) 


= s' a 


S2(s$,b) 

Wa,b) 


= 4 




= 


= S'a 


= 4 


S2(s'a,<) 




8i{s' b ,a) 


= s> a 


Sz(s' b ,b) 


= 4 







For nondeterministic non-centralized devices it is shown in that returning parallel communicating 
finite automata systems are neither weaker nor stronger than non-returning ones. The question whether 
the same equivalence is true in the deterministic case was answered in the affirmative in Q]. To this 
end, the so-called cycling-token-method is introduced. Basically, the main problem of that method was 
to break the synchronization at the beginning. Otherwise, when some component A i+ \ requests the state 
of Ai and, thus, A; reenters its initial state, then A, will request the state of A,_i and so on. But these 
cascading communication requests would destroy necessary information. The next lemma is shown by 
applying the cycling-token-method. 

Lemma 33. Let k>\. Then J£(DRPCFA(Jc)) includes £?{DPCFA(k)). 

One of the fundamental results obtained in |[25l is the characterization of the computational power of 
(unrestricted) parallel communicating finite automata systems by multi-head finite automata. 

Theorem 34. Let k > 1. Then the families ^(DRPCFA{k)), J^(DPCFA(k)), and Jf(lDFA(k)) are 
equal. 

Proof It remains to be shown that, for all k > 1, the family Jz?(lDFA(&)) includes Jzf (DRPCFA(yt)). 
Given some DRPCFA(^) si ', basically, the idea of simulating it by a deterministic one-way k-head finite 
automaton A' is to track all current states of the components of in the current state of A' (see [25 ]). □ 

Comparing deterministic centralized systems with non-centralized systems we obtain for centralized 
systems the surprising result that the returning mode is not weaker than the non-returning mode. Let 

L rc = {uc x v$uv | u,v G {a,b}* ,x > 0}. 

Theorem 35. The language L rc belongs to the family J£{DRCPCFA) (and thus to J£(DRPCFA) = 
££(DPCFA)), but not to ^{DCPCFA). 

Corollary 36. ^(DCPCFA) C ^(DPCFA) = ^f(DRPCFA). 
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In order to show that nondeterministic centralized systems are strictly more powerful than their deter- 
ministic variants we consider the language L m [ = {ww^ \ w E {a,b,c} + } and show that its complement 
belongs to Jzf (CPCFA), but does not belong to Jzf (DPCFA). 

Corollary 37. ^(DCPCFA) C % (CPCFA) and J*f (DPCFA) C ^(PCFA). 

Finally, we compare the classes under consideration with some well-known language families. 

Lemma 38. The family J£(PCFA) is strictly included in NL, hence, in the family of deterministic context- 
sensitive languages. 

Proof. Since L = {ww R | w £ {a,b,c} + } can be accepted by some 2NFA(2), language L belongs to NL. 
On the other hand, language L does not belong to Jzf (lNFA(fc)), for all k>\. □ 

Lemma 39. All language classes accepted by parallel communicating finite automata systems are in- 
comparable to the class of (deterministic) (linear) context-free languages. 

Proof. The language {w$w s | w G {a,b} + } of marked palindromes of even lengths is deterministic 
linear context free, but is not accepted by any lNFA(fc), for all k > 1. Thus, the language {w$w R | 
w € {a,b} + } does not belong to Jzf(PCFA). Conversely, the set {w$w | w € {a,b} + } belongs to 
Jzf (DRCPCFA) as well as to Jz^(DCPCFA), but is not context free. □ 

Lemma 40. All language classes accepted by parallel communicating finite automata systems are in- 
comparable with the class of Church-Rosser languages. 
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